Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
نویسندگان
چکیده
منابع مشابه
Crowdsourcing Transcription Beyond Mechanical Turk
While much work has studied crowdsourced transcription via Amazon’s Mechanical Turk, we are not familiar with any prior cross-platform analysis of crowdsourcing service providers for transcription. We present a qualitative and quantitative analysis of eight such providers: 1888-Type-It-Up, 3Play Media, Transcription Hub, CastingWords, Rev, TranscribeMe, Quicktate, and SpeakerText. We also provi...
متن کاملOpportunities for Crowdsourcing Research on Amazon Mechanical Turk
Many crowdsourcing studies have been conducted that utilize Amazon Mechanical Turk, a crowdsourcing marketplace platform. The Amazon Mechanical Turk team proposes that comprehensive studies in the areas of HIT design, workflow and reviewing methodologies, and compensation strategies will benefit the crowdsourcing field by establishing a standard library of repeatable patterns and protocols. Author
متن کاملBeyond Mechanical Turk: An Analysis of Paid Crowd Work Platforms
While Amazon’s Mechanical Turk (AMT) helped launch online crowd work in 2005, a myriad of newer vendors now offer alternative feature sets and workflow models for accomplishing quality crowd work. Unfortunately, research on crowd work has remained largely focused on AMT, with little exploration of other platforms. Such near-exclusive focus on AMT risks its particular vagaries and limitations ov...
متن کاملConducting behavioral research on Amazon's Mechanical Turk.
Amazon's Mechanical Turk is an online labor market where requesters post jobs and workers choose which jobs to do for pay. The central purpose of this article is to demonstrate how to use this Web site for conducting behavioral research and to lower the barrier to entry for researchers who could benefit from this platform. We describe general techniques that apply to a variety of types of resea...
متن کاملCrowdsourcing Music Similarity Judgments using Mechanical Turk
Collecting human judgments for music similarity evaluation has always been a difficult and time consuming task. This paper explores the viability of Amazon Mechanical Turk (MTurk) for collecting human judgments for audio music similarity evaluation tasks. We compared the similarity judgments collected from Evalutron6000 (E6K) and MTurk using the Music Information Retrieval Evaluation eXchange 2...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Experimental Social Psychology
سال: 2017
ISSN: 0022-1031
DOI: 10.1016/j.jesp.2017.01.006